On the Interplay Between Conditional Entropy and Error Probability
نویسندگان
چکیده
منابع مشابه
Relations between entropy and error probability
[4] I. CsiszAr and J. Komer, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York Academic, 198 1. [5] R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley. 1968. [6] A. I. Viterbi and J. K. Omura, Principles of Digital Communication and Coding. New York McGraw-Hill, 1979. [7] W. H. R. Equitz and T. M. Cover, “Successive refinement of informati...
متن کاملMaximum entropy and conditional probability
It is well-known that maximum entropy distributions, subject to appropriate moment constraints, arise in physics and mathematics. In an attempt to find a physical reason for the appearance of maximum entropy distributions, the following theorem is offered. The conditional distribution of X, given the empirical observation (1 /n)X:, ,/I ( X,) = (Y, where X, , X2, . are independent identically di...
متن کاملAnalytical Bounds between Entropy and Error Probability in Binary Classifications
The existing upper and lower bounds between entropy and error probability are mostly derived from the inequality of the entropy relations, which could introduce approximations into the analysis. We derive analytical bounds based on the closed-form solutions of conditional entropy without involving any approximation. Two basic types of classification errors are investigated in the context of bin...
متن کاملon translation of phatic communion and socio-cultural relationships between the characters of the novels
phatic communion is a cultural concept which differs across cultures. according to hofstede (2001), the u.s. tends to have individualistic culture; however, asian countries tend to have collectivistic cultures. these cultures view phatic communion differently. in individualistic cultures like u.s., phatic communion reflects speakers’ socio-cultural relationships in conversations. to see whether...
15 صفحه اولon the relationship between the knowledge of collocations and writing proficiency
بررسی رابطه دانش همنشینی لغات و مهارت نوشتاری در زبان انگلیسی چکیده این پژوهش درصدد آن است تا سه مسئله زیر را مورد بررسی قرار دهد: الف) وجود یا عدم وجود رابطه بین دانش زبان آموزان در حوزه همنشینی لغات با یکدیگر و دانش آنها در مهارت نوشتاری زبان انگلیسی؛ ب) یافتن پاسخی به این سوال که آیا تمامی انواع همنشینی های لغوی زبان انگلیسی به یک میزان برای زبان آموزان دشوارند یا خیر؛ پ) مقایسه زبان آمو...
15 صفحه اولذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2010
ISSN: 0018-9448,1557-9654
DOI: 10.1109/tit.2010.2080891